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Abstract 

I 

Mean  delay  times  at  certain  superposition  nodes  are  found  for  messages 
of  variable  length  in  a packet-switched  network.  These  improve  on  some 
previous  approximations.  The  output  from  these  nodes  is  such  that  exact 
mean  delays  in  some  larger  networks  may  be  found. 
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A system  of  queues  with  deterministic  servers  has  been  proposed  as  a 
model  for  a packet  switched  message  network.  One  advantage  of  constant 
service  times  is  that  the  distribution  of  the  total  delay  time  for  a set 
of  servers  in  series  c-ui  be  determined  (see  Avi-Itzhak  [1]).  This  has  been 
extended  to  variable  message  length  systems  by  Rubin  |2).  In  a network, 
however,  the  Mow  in  a series  of  such  service  facilities  will  be  subject 
to  interference,  either  by  externally  generated  messages,  assumed  to  form 
a Poisson  process,  or  by  the  output  ot  other  sections  of  the  network. 

Rubin  [3)  has  suggested  some  approximations  for  the 
mean  delay  times  in  simple  superpositions  of  this  type,  based  on  considering 
the  system  as  seen  by  each  type  of  traffic  separately.  The  approximations 
require  Poisson  assumptions  at  each  node.  This  note  shows  that  for  the  general 
class  of  systems  in  which  delays  are  large,  exact  expressions  for  the  mean 
delay  times  may  be  found,  which  allow  for  messages  of  varving  lengths,  and 
further  that  the  combined  output  from  such  systems  is  often  of  a form  which 
gives  exact  results  for  the  delays  at  subsequent  stations.  In  Figure  1, 
r example; 


I'  i gu  re  I 

where  the  input  streams  are  Poisson  with  parameters  A , A and  the  two 
stations,  l)|  and  I),  have  constant  processing  times,  d , d respectively, 
Rubin's  analysis  gives  the  mean  delay  of  a packet  at  I)  as: 
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An  exact  result  will  be  shown  to  be 

2 2 2 
j (Aj+A2)d  Ax  d 

W = 2 Hy^fd  ~2(Ai+A2)(1-A jT]T  ' dl  - d'  (Corollary  3.1) 


Furthermore,  in  this  case  the  output  from  D is  identical  to  that  from  an 
M/D/1  queue,  and  so  the  mean  delay  at  any  subsequent  station  may  be  found 
exactly. 

Generally,  messages  arrive  as  a set  of  n independent  Poisson  processes 
at  n stations.  A.1  is  the  mean  interarrival  time  at  the  i-th  station. 

l 

Message  lengths  are  independent  and  take  up  an  integral  number  of  packets, 
each  taking  constant  processing  time.  The  combined  output  of  the  n stations 
then  queues  for  service  at  station  D.  Messages  are  processed  at  D in  order 
of  arrival,  with  each  packet  taking  time  d.  The  system  can  be  modelled  as  a set 
of  queues  with  group  arrivals,  with  b(i,j)  the  probability  that  a group  of 
size  j arrives  at  server  i,  whose  service  time  is  tl  . 

I .et 

n A . 

B(  i)  ).'  / b(i,  j),  j ~ I , 2 A = A|  + ...+An, 
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where  p.  and  o are  the  mean  and  variance  of  the  group  size  in  the  arrival 


1 


’ 


Pi 

: 


-3- 

stream  to  station  i. 

Theorem  1.  For  0 <_d^  <_d,  i=l,...,n,  and  Xpd  < 1,  the  output  from  D 
is  identical  to  that  of  a group  arrival  M/D/1  queue  whose  mean  interarrival 
time  is  X \ service  time  is  d,  and  group  size  distribution  is  B(j). 

Proof.  We  show  that  the  idle  time  and  busy  period  distributions  at  D are 
those  of  an  M/D/1  queue. 

Note  that  since  d^  < d all  arrivals  from  a particular  busy  period  at 

server  i must  be  served  in  the  same  busy  period  at  D,  and  hence  that  an 

arrival  from  server  i who  initiates  a busy  period  at  D must  also  have  initi- 

» 

ated  a busy  period  at  server  i.  Also  the  superposition  of  the  n independent 
arrival  processes  is  still  a Poisson  process  with  group  arrivals.  The  group 
size  distribution  is  now  B(j). 

Suppose  that  D is  about  to  become  idle  at  some  time  t.  An  arrival  at 
i after  t — d ^ will  be  served  during  the  next  busy  period  at  D.  If  this 
arrival  occurs  at  time  t-d.  + x then  by  the  note  above  it  will  arrive  at  D at 

l 

t ime  t + x . 

Thus  the  idle  time  at  D is  independent  of  the  type  of  the  last  arrival, 
and  has  a distribution  function  given  by: 


.1  — > 
!o  V 


-(>  ■■+.  . . + An)  X 


dx  + + /'  X e-V  c-CA,-P-...  + An_i)x  dx 


1 


i 


We  write  l’(i,n|m)  for  probability  that  a busy  period  is  initiated  by  an  arrival 
from  stream  i and  is  n service  periods  long,  given  that  the  first  arrival 
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came  from  a group  of  m.  If  the  busy  period  appears  as  if  it  will  end  at 


time  t,  again  an  arrival  at  server  i will  only  extend  it  if  the  arrival  occurs 
time  t - d^.  Thus  from  the  independence  of  the  arrival  streams 


. . | . i -A.md  -(A  +...+A.  +A.+...+A  )md  , 

' (i,m|m)  = — — eiel  1-I1  n 


i -mAd  . 

— e 


Also  by  conditioning  on  the  completion  time  of  the  first  m service  periods 


P(l,J+.|»>  - £ -T-  l bk(r)  P(j|r>, 


since  as  far  as  the  busy  period  distribution  is  concerned  there  is  no 

difference  between  a busy  period  Initiated  by  an  arrival  requiring  r service 

periods,  and  one  initiated  by  a queue  of  r customers.  Here  F ( j | r ) = 
n k 

£ P(i,j|r),  and  b (r)  is  the  probability  that  the  total  number  of  arrivals 

i=l 

°o 

in  k groups  is  r.  b (r)  is  the  coefficient  of  zT  in  ( £ B(j)z*)  . 

j=l 

P(m|m)  = e™^,  m=l,2,... 


I* ( i+m|m)  = j e m'*<l  £ ~y)  l>k(r)  P ( j | r ) 

r- 1 k= 1 K‘ 


The  equations  (I)  are  identical  to  those  for  the  length  of  a busy 
period  ol  an  M/D/l  group  arrival  queue.  Their  solution  is  the  Boro  1 -Tanner 
distribution  ( see  Bhat  |4|,  page  10,  for  example). 


page  10,  for  example)* 
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P(j |m) 


to  -i  Ad 

= e J 
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( jXd) 
k! 


b (j-m) , j > m. 


Since  the  busy  period  length  is  conditionally  independent  of  the  source  of 
the  first  arrival,  the  output  from  D consists  of  a sequence  of  busy  periods 
whose  probability  functions  are  given  by  P(j|m),  where  m has  the  distribution 
B(m),  separated  by  independent  exponentially  distributed  idle  times. 

The  mean  delays  at  any  subsequent  set  of  stations  in  series  can  now 
be  found  from  [1]  and  [2]. 

Since  we  have  shown  in  Theorem  1 that  the  output  from  such  a system  is 
identical  to  that  from  a M/D/1  queue  it  seems  reasonable  to  expect  that  the  two 
mean  waiting  times  are  related.  Although  we  can  now  calculate  the  mean  time 
to  the  n-th  departure  from  the  system  it  is  not  necessarily  true  that  the 
arrival  who  is  the  n-th  departure  will  have  been  the  n-th  arrival  to  the 
system.  We  need  to  alter  the  service  discipline  at  server  D in  order  to  be 
able  to  compare  mean  arrival  and  departure  times. 

A particular  order  of  service  is  said  to  be  work-conserving  if  the  server 
is  not  idle  when  the  queue  is  non-empty,  and  each  customer  receives  his  full 
service  requirement  upon  entering  service.  Since  the  queue  length  distri- 
butions under  work-conserving  orders  will  be  identical,  from  Little's  formula 
we  have: 

Lemma  1 : For  a single  server  queue  with  a work-conserving  order  of 

service,  the  mean  waiting  time  of  an  arbitrary  customer  is  the  same  as  if 
the  order  or  service  is  f irst-come-f irst-served . 

We  modify  the  system  as  follows.  The  arrival  process  to  the  i-th  server 
starts  at  time  (0-d^).  At  one  of  the  starting  times  an  arrival  occurs 
so  witli  probability  one  there  is  an  arrival  to  I)  at  time  zero.  If  an 
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ar rival  occurs  to  the  i-th  server  at  time  t then  it  is  numbered  in  the  sequence 
it  i:  . t d occurred  at  time  • +r,  On  arrival  at  D groups  are 

served  in  order.  It  can  be  seen  that  sini  arrivals  during  a single  busy 

peri"d  .ire  served  in  the  same  busy  period  l he  modified  system  is  work- 

rv  ng.  Tiie  following  result  allows  u t Jentify  the  time  of  the  n-th 
departure . 

_!_•  ..  • • in  tne  modified  system  the  dep  t stream  from  D is  the  same 

as  rf  i-  rr-otn  an  M/D/1  group  arrival  queue. 

1 . - proof  of  this  follows  the  same  f steps  and  produces  the  same 

- as  that  of  Theorem  1. 


The  Tiean  message  delay  at  D,  W,  can  r found.  W is  the  time 

th<  arrival  of  the  first  packet  in  a e until  processing  begins. 

i:  rent  i:  For  d < d,  Apd  r l, 

1 

a .22  ? ^A-bj  , 2 

2([->7jd)  f } J-  2>~(T-'  ,‘i.j  (“i  + ’ i ) * 

i=l  i i i 

fing  the  Pollaczek-Khintchii  rmula  to  an  M/G/l  queue  with 
- te  service  time  distribution,  for  i irge  n the  departure  mean  time  of 
the  first  packet  of  the  n-th  message  is 

2 

•i  n-1  , >d  2 

I = + d + — r.  f H ' ). 

n > 2(1— Apd> 

lli'd  system  tite  arrival  lime  thi  packet  at  the  station  I)  is 


n A 


.d. 

i i 


. , v 1 11  2.  ? 

•f-  ) . 4 ■ 1 . 

n > . A VA  I -A  . p . d > » i 


i = I 


i l 


1 i in  <T  -A  -d)  the  result  folh 
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Corollary  3.1.  If  each  message  consists  of  one  packet, 

.2 


W = 


Ad 


2 ( 1-Ad) 


l 

i=l 


<Vi> 

2 A ( 1 - ' A . d .') 

l l 


then 


Corollary  3.2.  The  probability  that  a message  experiences  no  delay  in  the 
system  is  identical  for  each  type  of  traffic  and  is  given  by  1-Ayd. 

Proof : Messages  initiating  a busy  period  at  D will  necessarily  be  undelayed. 

From  Theorem  1 the  type  of  such  a message  is  random  and  so  the  required  pro- 
bability is  the  same  as  the  probability  of  not  waiting  for  an  arbitrary  cus- 
tomer in  an  M/D/1  queue. 

If  each  of  the  n input  streams  to  D is  identical,  (i.e.,  A =...=A  , 

1 n 

dj=...=d  , b( i , j )=B( j) ) , the  mean  delay  of  the  i-th  stream  at  D is 


W.  = 


Ad 


2 2 

(p  +a  ) - 


A . d . 

l l 


2 2 
r (P.  +a.  ) 


2(1-A.p.d.)  VHi  “i 


i 2 ( 1-Apd) 

We  conjecture  that  (2)  does  not  generalize  to  various  input  streams. 


(2) 


Since  the  group  size  distribution  is  known  the  waiting  time  of  individual 
packets  at  D can  also  be  found. 


Theorem  l does  not  cover  the  case  where  d.  > d for  some  i.  Since  some 

l 

interdeparture  intervals  will  be  of  length  d^  while  others  are  of  length  d, 
it  is  clear  that  the  output  from  D cannot  be  identified  with  that  from  an 
M/D/l  queue.  In  practical  situations  this  defect  may  not  be  important  for 
the  following  reasons.  If  most  of  d^.-.d^  are  greater  than  d then  mean  waiting 
time  at  D will  be  small  and  so  Rubin's  approximations,  giving  a tight  lower 
bound,  may  be  appropriate.  In  those  situations  where  long  waiting  times  are 
likely  to  occur,  that  is  a station  giving  long  processing  times  in  series  with 
I),  Lh»'  mean  delay  can  be  determined  without  anlayzing  the  output  ol  I)  as  follow 
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Figure  2 

Theorem  4:  For  d'  i d^,  i=l,...,n,  the  total  mean  waiting  time  in  the  system 

of  Figure  2 is  given  by 


2( Y- A u 3 ) ^ + ° ^ » w^ere  d = max(d.d'),  and  Apd  < 1, 

for  all  values  of  d. 

Proof : If  d > d^,  i=l,...,n,  then  we  have  shown  that  the  output  from  D is 

identical  to  that  of  an  M/D/1  queue  and  the  result  follows  immediately. 

For  d < d^  for  some  i then  d = d'.  It  is  clear  that  all  arrivals  in  a 
particular  busy  period  at  D must  be  served  in  the  same  busy  period  at  D'. 
Note  that  the  delay  arguments  in  Avi-Itzhak  apply  regardless  of  the  form 
of  the  input,  so  the  total  waiting  time  in  the  system  EH-D'-*-  satisfies: 


W 


n+1 


(W  + kd ' 
n 


t ) , where  kd'  is  the  length 


(3) 


of  the  n-th  message,  and  t is  the  time  between  the  arrival  of  n-th  and  (n+l)th 

n 


messages  at  D.  Now  consider  the  system  with  the  order  of  the  servers  D and 
D'  interchanged. 

The  waiting  time  in  the  D'  >D  system  is  still  governed  by  (1),  but  since 
d’>dj,  the  results  of  Theorems  1 and  3 may  be  applied.  Thus  the  mean  waiting 
time  in  the  l>>D'  system  is 

2 


(W 


( Ad)  .2  z.  r 

2 ( 1 -Apd)  2A(l-A.pJd< ) VHi  ' “i 


2 2 
(P4  +°.  ) 


ri  i' 


and  the  output  from  D1  is  identical  to  that  from  M/D'/l  group  arrival  queue. 
The  results  of  Theorem  4 can  obviously  be  extended  to  any  series  system. 


Theorem  4 suggests  a conjecture  about  delays  when  d.  > d.  Note  that 

reducing  any  d^  increases  the  mean  wait  at  D.  An  intuitive  explanation  for 

this  is:  reducing  dj  increases  the  variance  of  the  ith  input  stream  to  D, 

in  most  queues  the  mean  waiting  time  increases  with  the  variance  of  the  input 

stream.  We  conjecture  that  this  holds  true  when  some  of  the  d are  greater 

1 

than  d.  Thus  if  d^,...,  d^  > d,  < d,  at  least  for  single-packet 

messages  an  upper  bound  for  the  mean  wait  at  D is 


Xd 


2(1 -Ad) 


r (A.d)- 

^ 2A(1-A.d) 


( Aid.) 

i=r+l  2A(1-W 


- I 


(4) 


Clearly  such  a bound  will  be  lower  than  that  obtained  by  assuming  the 
input  to  D is  a Poisson  process.  It  takes  zero  or  infinite  values  at  all 
appropriate  points  and  gives  the  exact  value  of  the  mean  wait  on  the  boundary 
of  regions  where  Theorem  3 applies.  In  all  the  examples  examined  in  [3],  (4) 
forms  a tight  upper  bound  for  the  mean  waiting  time. 

It  would  appear  that  the  use  of  results  for  M/D/1  queues  gives  upper 
bounds  for  mean  waiting  times,  and  further  that  by  the  use  of  Theorem  4 
it  should  be  possible  to  extend  these  bounds  through  many  networks. 


The  Mean  Packet  Waiting  Time. 

Prom  Theorem  3 the  total  mean  waiting  time  of  the  first  packet  in  each 
message  is 


W 


Ad 


2 ( 1 -And) 


, 2 , 2. 

( |)  + o ) . 


The  mean  waiting  time  of  the  k-th  packet  in  a message  is  W + kd . 


S i nee 


the  distribution  of  the  number  of  packets  in  a message  is  known  the  average 

packet  waiting  time  in  the  system,  W , can  be  found. 

P 

Theorem  5:  For  d^  <_  d,  i=l , . . . ,n, Apd<l . 


W 

P 


2 2 

p +o 

p(l-Apd) 


1 


Proof : The  probability  function  for  the  number  of  packets  in  a message  is 


n A . 


I ~ b(i,j)  - B(j).  Since  all  packets  in  a message  are  served  consecutively 


i=l 


at  D,  the  mean  wait  of  an  arbitrary  packet  in  the  message  is 


I A (j-l)d 
— i=l  J 

W = W + 

P 


1 Aj 
.1  = 1  2  3 


, where  A.  = £ B(i) 

i=j 


Now 


W = W + 
P 


l r j(j+i)B(j>-  l jB( j) 

Ml j=l 

00 

1 jB(j) 

J-l 


d. 


W + 


2 2 
p +q  -u 

2p 


from  which  the  result  follows. 


The  mean  waiting  time  of  any  packet  at  D will  be 


2 . 2 

n A . d . 

PiV 

p +0 

_ 1 _ V i 1 

pT(T-ATu7d.y 

p(l-Apd) 

i=l  ZA 

(5) 


From  Lemma  1,  (5)  gives  the  mean  packet  waiting  time  at  D under  any  order 
of  service.  In  particular  it  applies  when  packets  are  served  in  order  of 
arrival  at  D,  rather  than  in  order  or  messages. 
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